Search for: All records

The Center for Advancing Research Impacts in Society (ARIS) Broader Impacts (BI) Toolkit is a collection of online, interactive tools focused on the generation of broader impacts activity plans that satisfy the criteria of proposals submitted to the National Science Foundation (NSF). The BI Toolkit includes a set of ARIS Guiding Principles, a Planning Checklist, the BI Wizard, and the BI Rubric. Over a three-year period, the ARIS BI Toolkit was pilot-tested with BI professionals located within ten institutions geographically distributed across the United States. The participating institutions represented a range of R1 and R2 institutions, Land-Grant Institutions, and Minority Serving Institutions with BI professionals serving in centralized and decentralized capacities within the institutions. This paper discusses the development of the ARIS BI Toolkit, its evolution through usability testing, a description of the BI Toolkit as it currently exists, and goals for future expansion. 

More than 27 years have passed since the National Science Board identified Broader Impacts as one of two merit criteria for National Science Foundation proposals. Yet many researchers remain less certain of how to develop, implement, and assess a broader impact plan. This multi-method study of a Broader Impacts (BI) rubric analyzed expert panels that included BI professionals and researchers for both content validity and reliability. Focus groups with researchers explicate the challenges researchers face regarding BI plans and the potential value of the rubric as a tool for use. It revealed the challenges researchers have in weighing proven strategies versus innovative strategies, a bias documented by other scholars. Researchers stated concern with how to weigh the different facets of the rubric to arrive at a single score. Moreover, researchers reported that their disciplinary field influenced how they interpreted the audiences whose needs and interests may be met through BI plans. These distinctions represent a range of different types of community engaged scholarship (e.g., public information network, community-campus partnership, K-12 schools’ partnerships). Finally, researchers found the BI rubric useful in evaluating and developing their own BI plans as well as their role in panels to ultimately strengthen the field of funded BI work. 

Abstract Simulation models are increasingly used by ecologists to study complex, ecosystem‐scale phenomena, but integrating ecosystem simulation modeling into ecology undergraduate and graduate curricula remains rare. Engaging ecology students with ecosystem simulation models may enable students to conduct hypothesis‐driven scientific inquiry while also promoting their use of systems thinking, but it remains unknown how using hands‐on modeling activities in the classroom affects student learning. Here, we developed short (3‐hr) teaching modules as part of the Macrosystems EDDIE (Environmental Data‐Driven Inquiry & Exploration) program that engage students with hands‐on ecosystem modeling in the R statistical environment. We embedded the modules into in‐person ecology courses at 17 colleges and universities and assessed student perceptions of their proficiency and confidence before and after working with models. Across all 277 undergraduate and graduate students who participated in our study, completing one Macrosystems EDDIE teaching module significantly increased students' self‐reported proficiency, confidence, and likely future use of simulation models, as well as their perceived knowledge of ecosystem simulation models. Further, students were significantly more likely to describe that an important benefit of ecosystem models was their “ease of use” after completing a module. Interestingly, students were significantly more likely to provide evidence of systems thinking in their assessment responses about the benefits of ecosystem models after completing a module, suggesting that these hands‐on ecosystem modeling activities may increase students’ awareness of how individual components interact to affect system‐level dynamics. Overall, Macrosystems EDDIE modules help students gain confidence in their ability to use ecosystem models and provide a useful method for ecology educators to introduce undergraduate and graduate students to ecosystem simulation modeling using in‐person, hybrid, or virtual modes of instruction.